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Abstract. Given a stationary first-order autoregressive process Xt 
(with lag-one correlation p satisfying |p| < 1), we examine the Central Limit 
Theorem for -ln|Xi • • ■ Xn\ and compute variances to high precision. Given 
a nonstationary process Xt (with \p\ > 1), we examine instead ^ln|X„| and 
study the distribution of In — n In \p\. 

This research began as an effort to better understand Viswanath's random integer 
recurrence [1]: 

Xt = Xt-i ± Xt-2, Xq = 1, Xi = 1, 
^ In \Xn\ ln(1.13198824...) almost surely as n ^ oo 
and one of Wright & Trefethen's real recurrences [2] : 

Xt = Xt-i + etXt-2, Xq = 1, Xi = 1, 

^ In \Xn\ — > ln(l. 057473553704...) almost surely as n ^ oo 

where Et is A^(0, 1) white noise. What are the corresponding asymptotic results for 
certain well-known recurrences in standard time series analysis? 

When IpI > 1, the nonstationary first-order autoregressive process 



Xt = pXt-i + VF^et, Xo = 

is readily shown to satisfy 

^ In \Xn\ — ^ In IpI almost surely as n — >• oo. 

The quantity In |p| is called the Lyapunov exponent of the system [3]. More precisely, 

p„ = E(ln |X„|) = i (ln(p2" - 1) - ln(2) - 7) , = Var(ln |X„|) = ^ 

where 7 denotes the Euler-Mascheroni constant We wish to ascertain the distri- 
bution of the errors (In |X„| — p„) /a, which do not appear to be A^(0, 1). 
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When IpI < 1, the stationary first-order autoregressive process 



gives rise to a different question. Here we have 

/i = E(ln \Xt\) = \{- ln(2) - 7) , = Var(ln \Xt 

in contrast to before. The Central Limit Theorem gives [Sj |6] 



t=i 



A^(0, 1) as n — > 00 



for some constant > 0; clearly ,^0 = ^- What is the numerical value of as a 
function of p 7^ 0? This is our first question to be addressed. 

0.1. Stationary Case. Let f{x) denote the iV(0, 1) density function and f^^\x) 
denote its j^^ derivative. Since Cov(Xi,X£+i) = for integer lag £ > 1, it follows 
that [7] 



E(ln|Xi|-ln|X,+i|) = 
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and therefore 



in \ oo 2 J2k 



2 1 - p2 6 1 - p4 45 1 - p6 35 1 - p8 

64 pi° 64 pi2 128 p^^ 

H ^- \ \ h 



1575 1 - pio 2079 1 - p^^ 21021 1 - pi^ 6435 1 - p^^ 
16384 pis 16384 p^o 131072 p^^ \ 

^984555 1 -pis ^ 1154725 1 - p^o ^ 10669659 1 - p22 " J 

via computer algebra. This is an example of what is called a Lambert series [8]. With 



we calculate 


eo.i = 


1.11527354305263680232. 


io.z = 


1.15562165351986837602. 




1.26199222423122947973. 


= 


1.52783735828651737636. 


^0.9 = 


2.55564072887132125752 



to 20 decimal places. 

As a corollary, if Yt is an Ornstein-Uhlenbeck process (Gauss-Markov process) 
satisfying 

dYt = -eYtdt + V2edWt, 0<t<T 
where ^ > and Wt is Brownian motion with unit variance, then [5] 

T 



|; y In IF^I dt — ^ 



> N(0, 1) as T ^ oo 

Ve 

for some constant rje > 0. A formula for rje is proved as follows [7]: 



E(ln|Fo|-ln|F^|) = E 

j=0 



J ln\y\f<^\y)dy 
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because Gov (Yq, Ye) = e for real lag £ > 0; hence 

T \ . T T 



/ T \ T T 

Var -= 1 In = J Gov (In IF^I, In |n|) ds dt 





upon setting i = t — s, di = —ds for fixed t; hence 

T T 




T t 

^ f f Gov(ln|ri|,ln|ri_,|) didt 



-j= Jln\Yt\dt] J Coy {ln\Yt_e\M\Yt\) dtdi 

^0 / i 



/ i 

upon reversing the order of integration; hence 

T \ ^ T T 

/T 



(1 I 2 

— J\n\Yt\dt^ = -JJCoY{\n\Yo\M\Ye\)dtdi 

T 

-/(T-£) (E(ln|ro|-ln|r£|)-/x^) ci£ 



0/0 
T 



2 oo 2 ^ 

^ '^2fc / irp i)\ -2k et 



and therefore 



{2k)\ \2ke ^ {2key 



^ 22^-2(A;- 1)!2 _ 1 ^ 





1 ^ 22^-2(A;- 1)!2 _ 1 ^ 22"-i 
^ti (2A:)!fc "^„^oC:)(r^ + iP(2n + l) 
1 /I ^, 7 



^ . ,7r^ln(2) - -C(3) = -(0.81146307722510340753...) 
u \4 8/0 

where ({s) denotes the Riemann zeta function [9j. Many analogous central binomial 
sums appear in [TO] . 
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0.2. Nonstationary Case. Since X„ ~ A^(0, p^" — 1), we deduce that 
/In \Xn\ - fin 



a 



<x\ = P (|X„| < 6'^^+'^' 



c / 9 

y 



7r(p2n - 1) J ^ 2{p 



exp I -T^rz^ — - 1 dy 







thus 



— P ' ' — —<x\ = X rexp — - 6'"^+''" a 

dx \ a -J V ^ P - 1 V 2 _ 1 y 



32(crx+/^„) 



IT / e 



2Yp2"-l V 2(p2n_l) 
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where z = nx/^/2 — 7. Clearly (ln|X„| — p„) /cr possesses a doubly exponential 
density function (called a Gumbel density or Fisher-Tippett Type I extreme values 
density [11]) with mean = 0, variance = 1, 

skewness = -^^C(3) = -1.53514159072290597506... 

and kurtosis = 7 — 3 = 4. Negativity of the third moment above confirms that the 
distribution is skewed to the left. Closed- form expressions for the quartiles do not 
exist: 

25*'^ %-tile = -0.45782337329420373497..., 
median = 50*^ %-tile = 0.21732071404060381038..., 
75*^ %-tile = 0.69796763838144042777... 
but the maximum point of the density is easily found: 

mode = + ^) = 0.57186419860436852975.... 

TT 

It is pleasing that, upon subtracting the "trend" from an AR(1) process, such a nice 
residual distribution emerges (independent of both p and n) . 
As a corollary, if Yt satisfies 



dYt = -9 Yt dt + dWt, Yo = 0, 0<t<T 
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where 6* < 0, then 

|; In ly^l —9 almost surely as T ^ oo 

and the density of (In 11^1 + T /cr approaches the same doubly exponential function 
as before. The proof is immediate. 

More generally, consider the nonstationary AR(m) process 

Xt = aiXt^i + a2Xt-2 + ■ ■ ■ + amXt-m + bet, 

Xq = X_i = ■ ■ ■ = X2^m = Xi^m = 0. 

Let A denote the m x m matrix with (ai, 02, . . . , cim) in the top row, Is on the 
subdiagonal and Os elsewhere. Order the complex eigenvalues Ai, A2, . . ., of A so 
that Ai has maximum modulus. When |Ai| > 1, AR(m) is shown to satisfy [T2] 

^ In |X„| —>■ In I All almost surely as n ^ 00. 

This occurs, for m = 2, if and only if |a2| > 1 or |ai| > 1 — a2- An evaluation of the 
residual distribution remains open. 

0.3. Variations. Surely the results given in this paper are not new! A careful 
literature search was unsuccessful. An example in [3] inspires us to look at the 
stationary case with et assumed to be U{—\/3, -\/3) white noise. Obviously E{Xt) = 
and Var(Xj) = L When p = 0, it follows that 

E(ln|Xt|) = iln(3) - 1 ^ ln(0.637), Var(ln|Xt|) = 1 

because each Xt is uniformly distributedjl] When p 7^ 0, this fact no longer holds and 
hence the relevant Central Limit Theorem parameters are not apparent. 
We conclude with a recurrence that somewhat resembles Viswanath's: 

Xt = pXt^i ± ^/V^, Xo = 

where |p| > 1 and plus/minus signs are equiprobable. While E(A'„) = and 
Var(X„) = p"^^ — 1 as in the Gaussian nonstationary case, it seems difficult to find 
E(ln |X„|) and Var(ln |X„|), let alone to find the distribution of residuals. 

^Thc numerical estimate E(ln \Xt\) w ln(0.2) in is evidently a mistake. 
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